Skip to content

LLM Proxy Features Added - #78

Merged
Saaketh0 merged 3 commits into
mainfrom
CAN-286-Bedrock-Streaming-Add
Sep 9, 2026
Merged

LLM Proxy Features Added#78
Saaketh0 merged 3 commits into
mainfrom
CAN-286-Bedrock-Streaming-Add

Conversation

@Saaketh0

@Saaketh0 Saaketh0 commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator

Added:

  • converse streaming support (for the ticket)
  • invoke streaming metrics support (only Anthropic)
  • invoke metrics support (only Anthropic)
  • anthropic/openai metrics support (separate from bedrock)

@Saaketh0 Saaketh0 self-assigned this Sep 9, 2026
@Saaketh0
Saaketh0 added this pull request to stack #62 September 9, 2026 05:18
@coderabbitai

coderabbitai Bot commented Sep 9, 2026

Copy link
Copy Markdown

Important

  • 🔍 Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Advanced

Run ID: d325b1e6-fff5-49e7-bc73-18cbd6696895


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@Saaketh0

Saaketh0 commented Sep 9, 2026

Copy link
Copy Markdown
Collaborator Author

Before, I was just getting the functionality to work, with only bedrocks converse getting metrics, so in addition to the added functionalities I added llm metrics to the rest.

Base automatically changed from cli/canyonos-name-change to main September 9, 2026 21:55
@Saaketh0
Saaketh0 force-pushed the CAN-286-Bedrock-Streaming-Add branch from 24f4043 to 9765aff Compare September 9, 2026 21:55
- ventis/llm_proxy/: an orphaned pre-rename copy of the LLM proxy package
  left behind by PR #76's merge. Verified nothing imports from it -- every
  real reference in the repo (local_controller.py, stub_generator.py, and
  this branch's own new tests) already points at canyonos_core.llm_proxy,
  which has this branch's actual streaming work. Dead weight, not wired
  to anything.
- VENTIS_TO_CANYONOS_RENAME.md: the pre-rename migration analysis/plan
  doc (dated 2026-09-05, explicitly 'no runtime code has been renamed
  yet'). The rename it planned has since been executed and merged
  (PR #76); the plan document is now stale.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@Saaketh0
Saaketh0 merged commit cdd03bc into main Sep 9, 2026
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants